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In the Claims 

No claims are canceled or added. Claims 46, 47, and 57 are amended. 
Claims 1-5, 10, and 19-63 remain in the application for consideration and are 
listed below: 



!• (ORIGINAL) A facial expression transformation method 
comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

2. (ORIGINAL) The method of claim 1, wherein the training set of 
expressions contains fewer expressions than the code book. 

3. (ORIGINAL) The method of claim 1, wherein the transformation 
function compensates for differences in the size and shape of the faces of the first 
and second persons. 
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4. (ORIGINAL) The method of claim 1 , wherein said deriving of the 
transfomiation function comprises computing a linear transformation from one set 
of expressions to another. 

5. (ORIGINAL) The method of claim 1, wherein the deriving of the 
transformation function comprises: 

representing each expression as a 3m-vector that contains x, y, z 
displacements at m standard sample positions; and 

computing a set of linear predictors aj, one for each coordinate of g^, given 
a set of n expression vectors for a face to be transformed, gar..ny and a 
corresponding set of vectors for a target face, g^^y by solving 3m linear least 
squares systems of the following form: 

aj'gai = gbi[jli = l.„n 

6. (CANCELED). 

7. (CANCELED). 

8. (CANCELED). 

9. (CANCELED). 

10. (ORIGINAL) The method of claim 1, wherein said providing data 
defining a second set of facial expressions comprises: 

illuminating the second person's face with illumination; and 
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contemporaneously capturing structure data describing the face's structure 
and reflectance data describing reflectance properties of the face from the 
illumination. 

11. (CANCELED). 

12. (CANCELED). 

13. (CANCELED). 

14. (CANCELED). 

15. (CANCELED). 

16. (CANCELED). 

17. (CANCELED). 

18. (CANCELED). 

19. (ORIGINAL) One or more computer-readable media having 
computer-readable instructions thereon which, when executed by a computer, 
cause the computer to: 

operate on a training set of expressions from one person and corresponding 
expressions from a code book of another person to compute a linear 
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transformation function from the training set and their corresponding expressions; 
and 

apply the transformation function to a plurality of expressions from the 
code book to provide a synthetic set of expressions. 

20. (ORIGINAL) The computer-readable media of claim 19, wherein 
the instructions cause the computer to use the synthetic set of expressions to 
transform expressions from the one person into expressions of the other person. 

21. (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform expressions from the one person 
that are different from those expressions comprising the code book expressions. 

22. (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform expressions by transmitting at 
least one index of a synthetic expression to a receiver that can reconstruct the 
expression. 

23. (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform facial expressions. 

24. (ORIGINAL) A facial expression transformation system 
comprising: 

a code book embodied on a computer-readable medium, the code book 
containing data defining a first set of facial expressions of a first person; 
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data embodied on a computer-readable medium, the data defining a second 
set of facial expressions, the second set of facial expressions providing a training 
set of expressions of a second person who is different from the first person; and 

a transformation processor configured to derive a transformation function 
from the training set of expressions and corresponding expressions from the first 
set of expressions. 

25. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation processor comprises a linear transformation processor. 

26. (ORIGINAL) The expression transformation system of claim 24 
further comprising a synthetic set of expressions embodied on a computer- 
readable medium, the synthetic set of expressions being derived by applying the 
transformation function to the code book expressions. 

27. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation function compensates for differences in the size and 
shape of the faces of the first and second persons. 

28. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation processor derives the transformation function by: 

representing each expression as a 3m-vector that contains x, y, z 
displacements at m standard sample positions; and 

computing a set of linear predictors ay, one for each coordinate of g^, given 
a set of n expression vectors for a face to be transformed, gaj...n, and a 
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corresponding set of vectors for a target face, gbj.^.n, by solving 3m linear least 
squares systems of the following form: 

aj'ga<^gb<[j],i = \,.M 



29. (ORIGINAL) A facial expression transformation system 
comprising: 

a transmitter comprising: 

a facial illumination system that is configured to provide multiple different 
light sources at the same time for illuminating a subject's face; 

a data-capturing system configured to capture both structure data and 
reflectance data from the subject's face when illuminated by the facial 
illumination system; and 

a first code book of synthetic expressions that have been synthesized by: 

receiving a training set of expressions provided by the subject; 

computing a transformation function using the training set of expressions 
and corresponding unsynthesized code book expressions; and 

applying the transfomiation function to all of the expressions in the code 
book; and 

a receiver communicatively linked with the transmitter and comprising: 
a reconstruction module for reconstructing facial images; and 
a second code book containing the same synthetic expressions as the first 
code book; and 

the transmitter being configured to: 

capture additional expressions of the subject; 
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search the first code book for a corresponding or near matching expression; 

and 

transmit an index of a corresponding or matching code book expression to 
the receiver for facial image reconstruction by the reconstruction module. 

30. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises at least one polarized light source. 

31. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises multiple polarized light sources. 

32. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises a pattemed light source configured to 
project a pattern onto the subject's face. 

33. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises an infrared pattemed light source 
configured to project a pattern onto the subject's face. 

34. (ORIGINAL) The expression transformation system of claim 29, 
wherein the different light sources are all infrared light sources. 

35. (ORIGINAL) A method of animating facial features comprising: 
defining a subdivision surface that approximates geometry of a plurality of 

different faces; and 
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fitting the same subdivision surface to each of the pluraHty of faces. 

36. (ORIGINAL) The method of claim 35, wherein said defining 
comprises defining the subdivision surface with a coarse mesh structure. 

37. (ORIGINAL) The method of claim 36, wherein the coarse mesh 
structure comprises a triangular mesh. 

38. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises performing a continuous optimization operation over vertex positions of 
the subdivision surface. 

39. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises fitting the subdivision surface to the faces without altering the 
connectivity of a mesh that defines the subdivision surface. 

40. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises minimizing a smoothing fianctional associated with a mesh that defines 
the subdivision surface. 

41. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises selecting one or more constraints associated with a mesh that defines 
the subdivision surface and fitting those constraints directly to corresponding 
points on the faces. 
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42. (ORIGINAL) The method of claim 41, wherein the constraints are 
associated with one of the eyes, nose and mouth. 

43. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises minimizing a functional that includes terms for distance, smoothness, 
and constraints. 

44. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises solving a sequence of linear least-squares problems. 

45. (ORIGINAL) One or more computer-readable media having 
computer-readable instructions thereon which, when executed by one or more 
computers, cause the one or more computers to implement the method of claim 35. 

46. (CURRENTLY AMENDED) A method of animating facial 
features comprising: 

defining a subdivision surface that approximates geometry of a plurality of 
different faces; 

fitting the same subdivision surface for only one expression to each of the 
plurality of faces to establish a correspondence between the faces for a plurality of 
expressions : and 

using the correspondence between the faces to transform an expression of 
one face into an expression of another face. 
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47. (CURRENTLY AMENDED) A method of animating facial 
features comprising: 

measuring 3-dimensional data for a plurality of different faces to provide 
corresponding face models; 

defining only one generic face model that is to be used to map to each 
corresponding face model; 

selecting a plurality of points on the generic face model that are to be 
mapped directly to corresponding points on each of the corresponding face 
models; and 

fitting the generic face model to each of the corresponding face models for 
only one expression to establish a correspondence between the faces for a plurality 
of expressions , said fitting comprising mapping each of the selected points directly 
to the corresponding points on each of the corresponding face models. 

48. (ORIGINAL) The method of claim 47, wherein: 

said defining comprises defining a subdivision surface from a base mesh 
structure, the subdivision surface containing a plurality of vertices and 
approximating the geometry of the face models; and 

said fitting comprises manipulating only the positions of the vertices of the 
subdivision surface. 

49. (ORIGINAL) The method of claim 47, wherein said fitting 
comprises manipulating a base mesh that defines a subdivision surface. 
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50. (ORIGINAL) The method of claim 47, wherein said fitting 
comprises manipulating a base mesh that defines a subdivision surface without 
altering the connectivity of the base mesh. 

51. (ORIGINAL) The method of claim 47, wherein said measuring 
comprises using a laser range scan to measure the 3-dimensional data. 

52. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions, wherein the deriving 
of the transformation function comprises: 

representing each expression as a 3/n-vector that contains x, y, z 

displacements at m standard sample positions; and 

computing a set of linear predictors ay, one for each coordinate of g^, 

given a set of n expression vectors for a face to be transformed, g^y. and a 

corresponding set of vectors for a target face, gt!,..n, by solving 3m linear 

least squares systems of the following form: 
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wherein said computing comprises using only a subset of points for 
each gaj; and 

applying the transfomiation function to the first set of expressions to 
provide a synthetic set of expressions. 

53. (PREVIOUSLY PRESENTED) The method of claim 52, wherein 
said using comprises using only points that share edges with a standard sample 
point under consideration. 

54, (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions, wherein the deriving 
of the transformation function comprises: 

representing each expression as a 3m-vector that contains x, y, z 

displacements at m standard sample positions; and 

computing a set of linear predictors fly, one for each coordinate of ga, 

given a set ofn expression vectors for a face to be transformed, and a 

corresponding set of vectors for a target face, g^y.„;„ by solving 3m linear 

least squares systems of the following form: 



LEE & HAYES, PLLC 



14 



0S2904W5I G:\MSl-0\S46us\ms I •546.m02,doc 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 




controlling the spread of singular values when computing a 
pseudoinverse to solve for the a/, and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

55. (PREVIOUSLY PRESENTED) The method of claim 54, wherein 
said controlhng the spread comprises zeroing out all singular values less than aG\, 
where G] is the largest singular value of the matrix. 

56. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising; 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person's face with illumination, said 
illuminating comprising: 

using multiple light sources, one of which projecting a pattern on the 
second person's face from which the structure data can be ascertained; 

at least one of the light sources comprising an infrared light source; 
at least one of the light sources being polarized; and 



LEE & HAYES, PLiiC 



15 



032904105) G:\MSJ'0\S46us\mst-546.m02.tloc 



J 

1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 




contemporaneously capturing structure data describing the face's 
structure and reflectance data describing reflectance properties of the face 
from the illumination, said capturing comprising using a camera having a 
polarizer that suppresses specularly-reflected light so that diffuse 
component reflection data is captured; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

57, (CURRENTLY AMENDED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, [[,]] wherein said providing data defining a 
second set of facial expressions comprises: 

illuminating the second person's face with a first polarized light 

source that is selected so that specularly-suppressed reflective properties of 

the face can be ascertained; 

illuminating the second person's face with a second structured light 

source that projects a pattern onto the face, while simultaneously 

illuminating the face with the first polarized light source; and 
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capturing both specularly-suppressed reflection data and structure 
data from the simultaneous illumination; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

58. (PREVIOUSLY PRESENTED) The method of claim 57, wherein 
the light sources provide light at different frequencies. 

59. (PREVIOUSLY PRESENTED) The method of claim 57, wherein 
the light sources provide infrared light. 

60. (PREVIOUSLY PRESENTED) The method of claim 57, fiirther 
comprising processing the captured data to provide both (a) data that describes 
dimensional aspects of the face and (b) data that describes diffuse reflective 
properties of the face. 

61. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
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is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person's face with multiple different light 
sources; 

measuring range map data from said illuminating; 
measuring image data from said illuminating; 
deriving a 3 -dimensional surface from the range map data; 
computing surface normals to the 3-dimensional surface; and 
processing the surface normals and the image data to derive an 
albedo map; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

62. (PREVIOUSLY PRESENTED) The method of claim 61, wherein 
at least one of the light sources is polarized. 

63. (PREVIOUSLY PRESENTED) The method of claim 61, wherein 
all of the light sources are polarized. 
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